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(57) In one embodiment, the present invention pro- 
vides a method of selecting a selectable element with a 
character input device from a list of lexically unordered 
selectable elements on a graphical user interface (GUI). 
Typically, these selectable elements include hypertext 
links and GUI buttons on the GUI of computer program 
executing on a computer system. Each selectable ele- 
ment includes a character portion of data which facili- 
tates selecting the selectable element. The method typ- 
ically begins the selection process when a user enters 
one or more characters from a character input device. 
In response to receiving the characters, the present in- 
vention inserts each character into a match string. The 
match string is then compared with the character portion 
of each selectable element on the GUI. A selectable el- 
ement is "armed" when the character portion of a se- 
lectable element is found which matches the match 
string. Arming a selectable element prepares the ele- 
ment for selection and typically involves highlighting, un- 
derlining or otherwise distinguishing the hypertext link 
from other text on a page. The user can then select the 
armed selectable element by actuating the "enter" key 
If a hypertext selectable element is selected then the 
information associated with a destination node (e.g., a 
web page) is displayed for the user. Instead of selecting 
the armed selectable element, the user may search for 
a different selectable element by entering additional 
characters and not actuating the "enter" key. The meth- 
od disclosed provides an improved selection method 
over prior methods because a user can quickly search 
and select a selectable element by typing a minimum 



number of characters. 
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Description 

The present invention relates to a method and sys- 
tem for facilitating access to selectable elements on a 
graphical user interface (GUI) used on computer sys- 
tems. 

More particularly the present invention relates to a 
method and system for accessing the selectable ele- 
ments in a GUI without a pointing device. 

Most computer programs executed on a computer 
system are controlled with a graphical user interface 
(GUI). The GUI displays selectable elements such as 
hypertext links and GUI buttons on a display device for 
the user to view and select. Typically, the user must use 
a pointing device, such as a mouse or trackball, to select 
the selectable elements provided by the GUI. Unfortu- 
nately, users who do not use a pointing device may be 
unable to use GUI based computer programs. For ex- 
ample, some users may have permanent physical dis- 
abilities or repetitive motion diseases, such as carpal 
tunnel syndrome, which prevents them from using a 
mouse or other pointing device. In other cases, the user 
may not want to use a pointing device in order to mini- 
mize the homing time associated with moving from the 
keyboard to the pointing device and back. It also may 
be necessary to eliminate the mouse from a computer 
system to reduce costs. In each case, these users would 
have great difficulty controlling a computer program 
which has a GUI interface For these reasons, there is 
a need to-access the selectable elements of a GUI with- 
out a pointing device. 

Numerous conventional methods developed for se- 
lecting selectable elements on a GUI without a mouse 
or pointing device do not optimize a user's input speed. 
These methods were developed when the number of se- 
lectable elements in a given system were small and the 
information relatively ordered. In contrast, increasingly 
popular hypertext systems such as the World Wide Web 
(WWW) have hundreds of selectable hypertext links 
which are lexically unordered. As pointed out below, 
these conventional systems do not provide an efficient 
and easy method of accessing these hypertext systems 
without a pointing device. 

Figure 1 illustrates the technique developed by 
CERN for accessing a hypertext link without a pointing 
device. In this system, a number is assigned to each 
hypertext link and then added to the hypertext link text 
displayed to the user. A user can select a particular hy- 
pertext link by entering the hypertext link number on a 
keyboard device. Actuating the "enter" key takes the us- 
er to the information (e.g., a "web"page) associated with 
the selected hypertext link. 

Unfortunately, the CERN method of accessing hy- 
pertext links is aesthetically unappealing. Adding num- 
bers to each hypertext link changes the layout and ap- 
pearance of the hypertext and impairs the designers 
ability to control the presentation of information on a 
screen. This tends to clutter the interface with unneces- 



sary information and thus reduce the overall ease of use 
for the user. Furthermore, the numbers added to each 
hypertext link take up space which could be used to 
store and display additional meaningful information 
5 rather than control information used to select the hyper- 
text link. 

The CERN system is also not advantageous on a 
system with a large number of hypertext links. In the 
CERN system a user can only view and select a link 

10 being displayed on the screen. Therefore, to view the 
additional links a user must scroll through numerous ad- 
ditional screens. Searching through a large number of 
hypertext links in this manner is both tedious and ineffi- 
cient For example, consider a web page on the WWW 

'5 which contains a list of all companies incorporated in the 
United States separated by each state. Many of the 
companies will have several entries on the web page 
because they are incorporated in several different 
states. A user may take hours to find the place of incor- 

20 poration for a particular company because he or she 
must scroll though multiple screens of information. Fur- 
thermore, the user will have no simple method of deter- 
mining if multiple entries in the hypertext system exist 
for a particular company. The CERN system will not in- 

25 dicate if multiple occurrences of a hypertext link appear 
on the same web page. Thus, the user may have a dif- 
ficulty determining if the company has been incorporat- 
ed in multiple states. 

The LYNX system is another method for accessing 

30 hyperlink information without using a pointing device. 
The LYNX system is shown in Figure 2. In the LYNX 
system a user must move sequentially through each hy- 
pertext link using a cursor key. A user actuates the ■en- 
ter" key to select the hypertext link indicated by the cur- 

35 sor. 

The LYNX approach solves some problems found 
in the CERN interface and introduces additional prob- 
lems of its own. The LYNX technique is an improvement 
over the CERN interface because no additional text 

*o must be placed in the hypertext links. However, the 
LYNX approach remains undesirable because it re- 
quires numerous keystrokes to locate a specific hyper- 
text link. On a large hypertext system, the excessive 
number of keystrokes may deter the user from using the 

4 5 system. For example, assume the previously mentioned 
web page contained a list of approximately 1 ,000 com- 
panies. On the average, the LYNX system could require 
up to 500 keystrokes to locate a hypertext link for a par- 
ticular company. This is clearly an inefficient technique 

so for accessing hypertext or GUI system buttons without 
a pointing device. 

The present invention provides an elegant method 
for selecting selectable elements on a GUI without a 
pointing device. The present invention is particularly 

55 well suited for hypertext systems with a large number of 
hypertext links such as the World Wide Web(WWW). 
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SUMMARY OF THE INVENTION 

In one embodiment, the present invention provides 
a method of selecting a selectable element from a list of 
selectable elements on a graphical user interface (GUI) s 
with a character based input device. The selectable el- 
ement is defined as any portion of the GUI responsive 
to the input signals from a pointing device or a character 
based input device. Typically, the selectable elements 
include hypertext and GUI buttons on the GUI of a com- 10 
puter program executing on a computer. In one embod- 
iment, the selectable element includes a character por- 
tion of data which facilitates selecting the selectable el- 
ement. 

In one embodiment, the method begins the selec- is 
tion process upon receipt of one or more characters 
from a character based input device. In response to re- 
ceiving the characters, the method inserts each charac- 
ter into a match string. The match string is then com- 
pared with the character portion of at least one selecta- 20 
ble element on the GUI. A selectable element is "armed" 
when a character portion of a selectable element is 
found which matches the match string. Arming a se- 
lectable element prepares the element for selection and 
typically involves highlighting, underlining or otherwise 25 
distinguishing the hypertext link from other text on a 
page. The method selects the armed selectable element 
upon receipt of an "enter" key or an equivalent input sig- 
nal from a character based input device. If a selectable 
element is selected then the information associated with 30 
a destination node (e.g., a web page) is displayed on a 
display device. Instead of selecting the armed selecta- 
ble element, the method may search for a different se- 
lectable element upon receipt of additional characters 
from a character based input device. This particular em- 35 
bodiment provides an improved selection method over 
prior methods because it requires a minimum number 
of characters to quickly search and select a selectable 
element on a GUI. 

In another embodiment, a match string timer is used 40 
to remove all the characters from the match string after 
a predetermined time has elapsed and the user has pro- 
vided no input. This predetermined time interval begins 
when a user enters a first character. In one embodiment, 
the match string timer is loaded with a predetermined 45 
timeout value each time the method receives a new 
character. The match string timer begins counting down 
immediately after detecting the new character. If the 
match string timer does not count down to zero before 
a subsequent character is entered, the additional char- so 
acter is appended to the match string. However, if the 
match string timer counts down to zero before a subse- 
quent character is received, the characters in the match 
string are removed and a subsequently entered charac- 
ter is inserted into an empty match string. In one em- s & 
bodiment, the predetermined time period is user defined 
and can be adjusted from one or more milliseconds up 
to one or more seconds of time. The match string timer 



4 

allows the user to make a new search by pausing a few 
moments between keystrokes. 

In yet another embodiment, a current location mark- 
er is used to alter the order in which one or more se- 
lectable elements are matched with the match string. In- 
itially, the current location marker is set to the first se- 
lectable element in a list of selectable elements in the 
GUI . The match string is first compared with the selecta- 
ble element indicated by the current location marker If 
the comparison produces a match, the selectable ele- 
ment is armed and the current location marker is ad- 
vanced to the next selectable element immediately sub- 
sequent to the armed selectable element. If the compar- 
ison does not produce a match, the current location 
marker is advanced to the next selectable element in 
preparation for another comparison. In one embodi- 
ment, the current location marker is advanced until a 
match is found or comparisons are made with all the se- 
lectable elements. The current location marker facili- 
tates multiple searches on a GUI having a large number 
of selectable elements. Moreover, each search by the 
present method will begin with the last selectable ele- 
ment that was armed. 

The present invention is faster and more powerful 
than the prior art because it requires a minimum number 
of characters to quickly search and select a selectable 
element on a GUI. 

Notations and Nomenclature 

The detailed descriptions which follow are present- 
ed largely in terms of methods and symbolic represen- 
tations of operations on data bits within a computer. 
These method descriptions and representations are the 
means used by those skilled in the data processing arts 
to most effectively convey the substance of their work 
to others skilled in the art. 

A method is here, and generally, conceived to be a 
self-consistent sequence of steps leading to a desired 
result. These steps require physical manipulations of 
physical quantities. Usually though not necessarily, 
these quantities take the form of electrical or magnetic 
signals capable of being stored, transferred, combined, 
compared : and otherwise manipulated, it proves con- 
venient at times, principally for reasons of common us- 
age, to refer to these signals as bits, values, elements, 
symbols, characters, terms, numbers, or the like. It 
should be bourne in mind, however, that all of these and 
similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels ap- 
plied to these quantities. 

Useful machines lor performing the operations of 
the present invention include general purpose digital 
computers or similar devices. The general purpose 
computer may be selectively activated or reconfigured 
by a computer program stored in the computer. A special, 
purpose computer may also be used to perform the op- 
erations of the present invention. In short, use of the 
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methods described and suggested herein is not limited 
to a particular computer configuration. 

The present invention will now be further described, 
by way of example, with reference to the accompanying 
drawings, in which :- 

Figure 1 illustrates a previously used technique de- 
veloped by CERN for accessing a hypertext link without 
a pointing device. 

Figure 2 illustrates the existing LYNX technique for 
accessing a hypertext link without a pointing device. 

Figure 3 is a block diagram of a computer system 
which provides an environment for practicing one em- 
bodiment of the present invention. 

Figure 4, illustrates a GUI system designed to dis- 
play information from the World Wide Web (WWW). 

Figure 5 is a flow diagram that provides an over- 
view of the processing that takes place when one em- 
bodiment is used to select various selectable elements 
without a pointing device or mouse. 

Figure 6 is a flow diagram that illustrates the steps 
to process a match string timer. 

Figure 7 is a flow diagram illustrating the steps tak- 
en to process GUI metacharacters. 

Figure 8 illustrates which hypertext link is highlight- 
ed on a web page from the World Wide Web when a 
user enters the character from a keyboard device. 

Figure 9 illustrates which hypertext link is highlight- 
ed on a web page from the World Wide Web when a 
user enters the character "S B trom a keyboard device at 
two separate instances 

Figure 10 illustrates which hypertext link is high- 
lighted on a web page from the World Wide Web when 
a user enters the characters "St" from a keyboard de- 
vice. 

Figure 11 illustrates various embodiments of the 
present invention using a fast path list for storing se- 
lectable elements in a GUI. 

DETAILED DESCRIPTION 

Overview Of an Embodiment of the Invention 

In one embodiment, the present invention provides 
a method of selecting a selectable element from a large 
number of selectable elements on a graphical user in- 
terface (GUI) without a pointing device. The selectable 
element is defined as any portion of the GUI responsive 
to the input signals from a pointing device or a character 
based input device. Typically, these selectable elements 
include hypertext and GUI buttons on the GUI of a com- 
puter program executing on a computer. On most large 
network based systems, such as the World Wide Web 
(WWW), the selectable elements are not sorted lexically 
by title or topically according to their subject matter. In- 
stead, data on the large network based systems re- 
mains unsorted. This vast amount of unsorted data 
makes accessing specific selectable elements especial- 
ly difficult. The present embodiment provides an im- 



proved selection method over prior methods because it 
requires a minimum number of characters to quickly 
search and select a selectable element on a GUI. 

In one embodiment the method begins the selection 
s process upon receipt of one or more characters from a 
character based input device. In response to receiving 
the characters, the method inserts each character into 
a match string. The match string is then matched with 
the character portion of each selectable element on the 
to GUI. A selectable element is "armed" when a character 
portion of a selectable element is found which matches 
the match string. Arming a selectable element prepares 
the element for selection and typically involves highlight- 
ing, underlining or otherwise distinguishing the hyper- 
's text link from other text on a page. The method selects 
the armed selectable element upon receipt of an "enter" 
key or an equivalent input signal from a character based 
input device. If a selectable element is selected then the 
information associated with a destination node (e.g., a 
20 web page) is displayed on a display device. Instead of 
selecting the armed selectable element, the method 
may search for a different selectable element upon re- 
ceipt of additional characters from a character based in- 
put device. 

2S In another embodiment, a match string timer is used 
to remove all the characters from the match string after 
a predetermined time has elapsed and the user has pro- 
vided no input. This predetermined time interval begins 
when a user enters a first character. In one embodiment, 

30 the match string timer is loaded with a predetermined 
timeout value each time the method receives a new 
character. The match string timer begins counting down 
immediately after detecting the new character. If the 
match string timer does not count down to zero before 

3S a subsequent character is entered, the additional char- 
acter is appended to the match string. However, if the 
match string timer counts down to zero before a subse- 
quent character is received, the characters in the match 
string are removed and a subsequently entered charac- 

40 ter is inserted into an empty match string. In one em- 
bodiment, the predetermined time period is user defined 
and can be adjusted from one or more milliseconds up 
to one or more seconds of time. The match string timer 
allows the user to make a new search by pausing a few 

45 moments between keystrokes. 

In yet another embodiment, a current location mark- 
er is used to alter the order in which one or more se- 
lectable elements are matched with the match string. In- 
itially, the current location marker is set to the first se- 

so lectable element in a list of selectable elements in the 
GUI. The match string is first compared with the selecta- 
ble element indicated by the current location marker. If 
the comparison produces a match, the selectable ele- 
ment is armed and the current location marker is ad- 

55 vanced to the next selectable element immediately sub- 
sequent to the armed selectable element. If the compar- 
ison does not produce a match, the current location 
marker is advanced to the next selectable element in 
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preparation for another comparison. In one embodi- 
ment, the current location marker is advanced until a 
match is found or comparisons are made with ail the se- 
lectable elements. The current location marker facili- 
tates multiple searches on a GUI having a large number 
of selectable elements. Moreover, each search using 
this one embodiment will begin with the last selectable 
element that was armed. 

Embodiments of the present invention are faster 
and more powerful than the prior art because they re- 
quire a minimum number of characters to quickly search 
and select a selectable element on a GUI. 

Overview Of One Embodiment 

Figure 3 is a block diagram of a computer system 
300 which illustrates a computer system for practicing 
various embodiments of the present invention. Typically, 
a computer system 300 includes a computer 302, a dis- 
play device 304, an input device 306 such as a key- 
board, a primary storage device 308 and a secondary 
storage device 310. The display device 304 displays a 
graphical user interface (GUI) 31 2 for facilitating the dis- 
play of graphics and text for the user using the system 
300. Display devices 304 include, for example, printers 
and computer display screens such as cathode ray 
tubes (CRT's), light-emitting diode (LED) displays, and 
liquid crystal displays (LCD's). Input devices 306 can in- 
clude, without limitation, electronic keyboards and point- 
ing devices such as electronic mice, trackballs, light- 
pens, thumbwheels, digitizing tablets, and touch sensi- 
tive pads. 

The computer 302 includes a processor 314 which 
fetches computer instructions from a primary storage 
308 through an interface 316, such as an input/output 
subsystem, connected to a bus 318. Computer 302 can 
be, but is not limited to, any of the SPARCstation or Ultra 
workstation computer systems available from Sun Mi- 
crosystems, Inc. of Mountain View, California, any other 
Macintosh computer systems based on the PowerPC 
processor and available from Apple Computer, Inc. of 
Cupertino, California, or any computer system compat- 
ible with the IBM PC computer systems available from 
International Business Machines, Corp of Somers, New 
York, which are based upon the X86 series of proces- 
sors available from the Intel Corporation or compatible 
processors. 1 Processor 314 executes these fetched 
computer instructions. The processor 31 4 can be, but is 
not limited to, any of the SPARC processors available 
from Sun Microsystems, Inc. of Mountain View, Califor- 
nia or any processors compatible therewith. Executing 
these computer instructions enables the processor 314 
to retrieve data or write data to the primary storage 308, 
display information on one or more computer display de- 
vices 304, receive command signals from one or more 

1 . Sun, Sun Microsystems, the Sun"loij6, SPARC, and Ultra are trade- 
marks or registered trademarks of Sun Microsystems, Inc. in the United 
States or other countries. 



input devices 306, or transfer data to secondary storage 
310 or even other computer system which collectively 
form a computer network (not shown). Those skilled in 
the art understand that primary storage 308 and sec- 

s ondary storage 310 can include any type of computer 
storage including, without limitation, randomly accessi- 
ble memory (RAM), read-only-memory (ROM), applica- 
tion specific integrated circuits (ASIC) and storage de- 
vices which include magnetic and optical storage media 

10 such as CD-ROM. 

The primary storage 308 stores a number of items 
including a GUI program 320 and an runtime environ- 
ment 322. The runtime environment 322 typically is an 
operating system which manages computer resources, 

15 such as memory, disk or processor time, required for the 
present invention to run. The runtime environment 322 
may also be a microkernel, a message passing system, 
one or more dynamic loadable iinkable modules, a 
browser application for the World Wide Web. a runtime 

20 interpreter environment, or any other system which 
manages computer resources. 

The World Wide Web 

25 The exemplary embodiment described below in ac- 

cordance with Figured 5-11 selects selectable ele- 
ments, such as hypertext links, on the World Wide Web 
(WWW) without a pointer device. As such, it is useful to 
understand how the WWW is constructed and how one 

30 embodiment of the present invention could be used to 
select a selectable element on the WWW. 

Figure 4 illustrates a typical GUI based system 400 
designed to display information located on the WWW 
404. The WWW 404 is a warehouse for millions and mil- 

35 lions of bytes of data contained in discrete storage ele- 
ments called web pages. A web page 406 contains data 
408 and a layout language 41 0 which describes how the 
data should be displayed. The layout language 410 
used within each web page, for example, includes any 

40 combination of Java™, JavaScript™, VRML, hypertext 
markup language (HTML) or any other language which 
supports hypertext functionality. 1 !. The user views a 
web page from the World Wide Web using a particular 
type of GUI program called a browser. A browser 402 

45 accepts the data 408 and the layout language 410 and 
in response produces a graphical image containing hy- 
pertext links along with text, graphics and various other 
types of multimedia. 

The hypertext links are of particular importance 

50 because they facilitate access to web pages located 
all over the WWW. An anchor tag in HTML is used to 
define a hypertext link on the WWW. The anchor tag 
has a destination portion and a text portion. Further- 
more, the anchor tag is delimited at the beginning by 

55 a "< A>" and at the end by a "</A> M character sequence. 
The destination portion contains an entry which indi- 
cates the location of the destination web page. The text 
portion is the text which appears on the GUI and is as- 
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sociated with the hypertext link. For example, consider 
a hypertext link having the following HTML anchor tag: 
<A HREF=http://sunweb.ebay/sunweb/orgs> 
Sun Microsystems</A> 

The destination portion of this tag is "http://sunweb. 
ebay/sunweb/orgs." The text M Sun Microsystems" occu- 
pies the text portion of this HTML based hypertext link. 
In an exemplary embodiment, the text portion of the an- 
chor tag is utilized by the present invention, as described 
in detail later herein, to facilitate searching and selecting 
hypertext links on the WWW without a pointing device. 

The present invention is not limited for use with GUI 
systems designed for the WWW. One skilled in the art 
could apply the teachings and suggestions of the 
present invention to any GUI system which has text as- 
sociated with selectable elements. Essentially, selecta- 
ble elements includes all portions of the GUI which are 
responsive to the input signals from a pointing device or 
a character based input device. 

Exemplary Steps of One Embodiment 

Figures 5-11 illustrates one method for practicing 
the present invention. The flow diagrams described 
herein broadly illustrate the logical flow of steps to per- 
form one embodiment of the present invention. Accord- 
ingly, numerous steps may be added to, or taken away 
from the flow diagrams, without departing from the 
scope of the invention. Furthermore, the order of exe- 
cution of the steps in the flow diagrams may be changed 
without departing from the scope of the invention. Addi- 
tional considerations in implementing the method de- 
scribed by the flow diagrams may also dictate changes 
in the selection and order of the steps. 

Figure 5 is a flow diagram that provides an over- 
view of the processing that takes place in the GUI 402 
when an embodiment of the present invention is used 
to select various selectable elements without a pointing 
device or mouse. Before processing begins, the present 
embodiment initially requires a list of selectable ele- 
ments to select from. Typically, a list of selectable ele- 
ments is generated from data provided by an underlying 
application using the GUI program. For example, on the 
World Wide Web (WWW) a web page contains a list of 
anchor tags which describe hypertext links in HTML A 
browser processes these anchor tags and displays cor- 
responding hypertext links to the user on a display de- 
vice. This embodiment receives the text portion of these 
anchor tags and creates a selectable element list for fur- 
ther processing described below. 

Generally, selecting a selectable element requires 
several steps. First, the user indicates to the method 
which selectable element should be armed by actuating 
one or more characters with a character based input de- 
vice. The method then highlights the armed selectable 
element in preparation for selection by the user. Next, 
the user actuates a selection character, such as an "en- 
ter" key, indicating that the armed selectable element 
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should be selected. In response to receiving the selec- 
tion character, the method selects the armed selectable 
element. Generally, selecting a selectable element 
causes the functionality associated with the selectable 

s element to be performed (i.e. retrieving a "web* page). 
In one embodiment, selecting the selectable ele- 
ment follows the steps 502-528 in Figure 5. At step 502, 
the current location marker is set to the first selectable 
element in the selectable element list the first time the 

10 invention is used. The current location marker indicates 
which selectable element should be compared first in 
the matching process described below. For example, 
Figure 8 shows a web page displayed on a browsercon- 
taining several hypertext links as indicated by the un- 

15 derlined text. In an exemplary embodiment, the current 
location marker in Figure 8 is initially set to the first hy- 
pertext link 802 indicated by the characters "Sun Micro- 
systems". 

At step 504 the method receives a character on a 

20 character based input device such as a keyboard. In 
step 506, the method analyzes the character and deter- 
mines if the character received was an "enter" key. In 
general, the "enter" key represents any input signal 
which indicates that a selectable element should be se- 

2S lected. If the method receives the "enter" key, the se- 
lectable element is selected as described in detail be- 
low. At step 508, the method adds the character to a 
match string. The match string holds a set of characters 
entered by the user for use in the matching step 510. 

30 At step 510 character comparison techniques well 
known in the art are used to compare the match string 
with one or more selectable elements. In one embodi- 
ment, a sequence of one or more characters in the 
match string is compared to a sequence of one or more 

35 characters associated with one or more selectable ele- 
ments. The method begins the comparisons starting 
with the selectable element indicated by the current lo- 
cation marker. 

Steps 516-520 prevent two selectable elements 

40 from being armed simultaneously. Initially, a selectable 
element may be armed from a previous attempt to select 
a selectable element. This occurs when the method 
arms a selectable element without subsequently select- 
ing it. At step 516, the method detects if there is a pre- 

45 viously armed selectable element and a new selectable 
element is about to be armed. In one embodiment, if a 
selectable element was armed from a previous match- 
ing step, the method will disarm the previously armed 
selectable element at step 518 before the new matching 

50 selectable element is armed at step 520. If no selectable 
element was previously armed, the method will bypass 
step 518 and arm the matching selectable element at 
step 520 directly. Generally, the selectable element is 
armed when the matching step determines the charac- 

55 ters within the match string match the text portion of the 
selectable element. Arming a selectable element in- 
cludes highlighting, underlining or otherwise distin- 
guishing the text of the selectable element from other 
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text within the current page being displayed to the user. 

Figure 8 and Figure 1 0 will be used to illustrate how 
a previously armed selectable element is disarmed be- 
fore a new selectable element is armed. Assume a user 
has entered the character "S" with a keyboard device 
and caused the hypertext link 802 to become armed. At 
this point, the current location marker is pointing to the 
hypertext link immediately subsequent to hypertext link 
802. Before selecting hypertext 802, however, the user 
then enters the letter T using the keyboard. The method 
adds the letter V to the match string (step 508) and pro- 
ceeds to compare the match string with the subsequent 
selectable elements starting with the current location 
marker. The method indicates a match between the 
match string and a hypertext link 1002 (step 510). As a 
result, step 518 disarms hypertext link 802 in Figure 8 
containing the text "Sun Microsystems" and arms the 
hypertext link 1002 in Figure 10 containing the text 
"Starfire". In this way, only one selectable element is 
armed at any given moment and the user is not distract- 
ed by having multiple selectable elements to choose 
from. Also, the previously armed selectable element re- 
mains visibly armed on the display unit up until a new 
selectable element is armed. 

Referring back to Figure 5, at step 528 the current 
location marker is advanced to the first selectable ele- 
ment subsequent to the matching selectable element. 
This causes the next search to occur subsequent to the 
matching selectable element. For example, in Figure 8 
the current location marker is initially set to a hypertext 
link 802 because it is the first selectable element on the 
web page. Assume the method receives the letter "S" 
from a character based input device. The method re- 
ceives the letter "S" and places it in the match string 
(step 508). Next, the matching step compares the "S" in 
the match string with the character portion of one or 
more hypertext link in the current web page until a match 
is found (step 510). In this case, the matching step 510 
arms the hypertext link 802 in Figure 8 because the 
character "S" in the match string matches the character 
"S" in "Sun Microsystems*. Moreover, the method ad- 
vances the current location marker to the first selectable 
element subsequent to the hypertext link 802 (e.g. the 
hypertext link containing the text "SunSoft"). Now as- 
sume the user removes the letter "S° from the match 
string by typing a backspace and then enters a new let- 
ter "S" into the match string. In this case, the method 
arms hypertext link 902 in Figure 9, in a manner de- 
scribed above, because the hypertext link 902 pointed 
to by the current location marker matches the match 
string. 

In some cases, the method will receive a sequence 
of characters from a character based input device which 
do not match any selectable element in the GUI. The 
user entering these characters may be searching for se- 
lectable elements which do not exist on the particular 
GUI being displayed. This portion of the invention han- 
dles the case where no selectable element matches the 



characters in the match string. Referring back to Figure 
5, at step 510 the method determines if the characters 
in the string do not match a selectable element. In one 
embodiment, if the selectable element has already been 

5 armed (step 512) the method will indicate an error (step 
514). Those of ordinary skill will understand that the er- 
ror indication provided by the method includes audio 
feedback, visual feedback or any other feedback capa- 
ble of indicating an error to the user. The error indicates 

10 that the additional characters received by the method 
do not match another selectable element on the GUI. 
Consequently, the method may already have armed the 
selectable element which most closely matches the 
characters in the match string. In contrast, if no selecta- 

15 ble element has been armed the method will return to 
step 504 to receive additional characters from the user 
and will not make an error indication. In this case, the 
method has not found a selectable element which 
matches the characters in the match string. 

20 After steps 512, 514, or 528, the method returns to 

step 504 to receive an additional character input from 
the user. This portion of the processing determines 
whether a selectable element should be armed or the 
armed selectable element should be selected. At step 

2S 506, if an additional character, other than the "enter" key 
or an equivalent input signal, is provided, the method 
will add the character to the match string (step 508) and 
arm a selectable element in accordance with steps 
510-528. Alternatively at step 506, if the method re- 

30 ceives the "enter" key, or an equivalent input signal 
which indicates that a selectable element should be se- 
lected, the method first determines if a selectable ele- 
ment is currently armed (step 522). If a selectable ele- 
ment is currently armed (step 522) ; the method selects 

35 the armed selectable element (step 524). When the 
method selects the selectable element (step 524), the 
functionality associated with the selectable element is 
performed. For example, Figure 8 illustrates a previous- 
ly armed hypertext link 802 containing the words "Sun 

40 Microsystems". Upon receipt of the "enter" key, an ex- 
emplary embodiment selects hypertext link 802, re- 
trieves the web page for "Sun Microsystems" and dis- 
plays the information associated with the web page on 
display device. 

45 it the method receives the "enter" key and no se- 
lectable element is currently armed then, at step 526, 
the system will generate an error message for the user. 
This error indicates that the user of the method has at- 
tempted to select a selectable element which has not 

50 been armed. At step 526, various embodiments can be 
used to indicate that a user is attempting to select a se- 
lectable element before it has been armed. In one em- 
bodiment, an audible message is provided when a user 
tries to select a selectable element before a selectable 

55 element has been armed. In an alternative embodiment, 
a visual image or message is provided to the user trying 
to select a selectable element before a selectable ele- 
ment has been armed. For example, the method may 
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provide an audible beep the first and second time the 
user actuates the "enter" key without a selectable ele- 
ment first being armed. The third time, however, a win- 
dow may appear indicating that the user has attempted 
to select a selectable element before an element has 
been armed. Those skilled in the art understand that var- 
ious combinations of audio and visual messages may 
be provided to ensure the user realizes an error has 
been made. 

The Match String Timer 

In an alternative embodiment, a match string timer 
is used to remove characters stored in the match string 
at step 508. Figure 6 is a flow diagram that illustrates 
the steps taken to process the match string using a 
match string timer. At step 602, an embodiment of the 
present invention receives a character from the user. At 
step 604, if the match string timer counts down to zero 
and times out the method removes all characters from 
the match string (step 606). However, if the match string 
timer has not timed out (step 604) then the method in- 
serts the character into the match string (step 608). 
Each time a character is received the system loads the 
match string timer with another predetermined timer val- 
ue (step 610). Immediately after loading the match string 
timer the match string timer begins a new countdown 
process (step 61 2). The match string timer ensures that 
a new match string is used at step 508 for comparisons 
when a user pauses a predetermined time interval be- 
tween key strokes. 

GUI Metacharacters 

In yet another alternative embodiment, the method 
receives a GUI metacharacter from a character based 
input device which controls the operation of the GUI. In 
one embodiment, these special keystrokes are reserved 
for use as GUI metacharacters and are not compared 
with the text of the selectable elements within the GUI. 
GUI metacharacters are advantageous in a mouseless 
environment because they provide an efficient method 
of controlling the GUI without a pointer device. In one 
embodiment, the processing of GUI metacharacters oc- 
curs after step 506 and before either step 504 or step 
508. Figure 7 illustrates the processing of these GUI 
metacharacters in detail. 

Referring to Figure 7, a flow diagram outlines the 
method in which several GUI metacharacters are proc- 
essed. The method performs steps 704-718 to process 
GUI metacharacter. At step 704, the method determines 
if the user provided a screen scroll GUI metacharacter. 
At step 706, the method causes a screen of information 
on the GUI to scroll up upon receipt of an up-screen 
scroll character (not shown). At step 706, the method 
can also cause a screen of information on the GUI to 
scroll down upon receipt of a down-screen scroll char- 
acter (not shown). In one embodiment, the method sets 



the current location marker to the first selectable ele- 
ment which appears in the screen each time the GUI 
window scrolls up or down to a new set of selectable 
elements. 

5 At step 708, the method determines if the user pro- 
vided a fast path store keystroke. The fast path list is a 
collection of often used or desirable selectable elements 
on the GUI. The method stores the armed selectable 
element to be stored in a fast path list upon receipt of a 

io fast path store keystroke character. Later, the method 
provides the fast path list of selectable elements to the 
user for additional searching. In one embodiment, the 
fast path list of selectable elements is displayed in a 
"pop-up" type window on the GUI. The user searches 

15 the fast path list by entering characters from a character 
based input device. In response, the method receives 
these characters and searches through the fast path list 
in a manner similar to the one described in steps 
502-528. 

20 Figure 11 illustrates various embodiments of fast 
path lists for storing selectable elements in a GUI. In one 
embodiment, selectable elements from GUI pages 
1102, 1104, and 1106 are stored in separate fast path 
lists 1108, 1110, and 1112 respectively. This allows the 

25 user to segregate important hypertext links from each 
web page in separate lists. In yet another embodiment, 
selectable elements retrieved from GUI pages 1114, 
1116, and 1118 are stored in a single fast path list 1120. 
In this case, the user can consolidate all important hy- 

30 pertext links in a central location for easy access. Those 
skilled in the art understand that the selectable elements 
in the fast path list may be deleted by user using tech- 
niques well known in the art. Furthermore, the Applicant 
contemplates that the hypertext links contained within 

35 the fast path lists in either embodiment can be sorted 
lexically, chronologically by topic, or even by frequency 
of use. 

Referring back to Figure 7, at step 71 2 the method 
may also determine if the user provided a clear match 
^0 string GUI metacharacter. In response to receiving the 
clear match string GUI metacharacter, the method re- 
moves all characters in the match string (step 714). This 
enables the user to quickly remove the characters in the 
match string and begin searching for a new selectable 
45 element in the GUI. 

In general, GUI metacharacters are designed to 
make searching and selecting a selectable element 
without a pointing device a more efficient process. In 
one embodiment, if a combination of GUI metacharac- 
50 ters arms a selectable element, the current location 
marker is advanced to the next subsequent selectable 
element. This enables the user to advance the current 
location marker using one or more GUI metacharacters 
and then begin searching subsequent to the current lo- 
ss cation marker's new location. For example, a user en- 
ters several "tab" keystrokes to advance to a particular 
hypertext link on a web page. In one embodiment, the 
particular hypertext link is armed and the current loca- 
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tion marker is advanced to the next subsequent hyper- 
text link. In an alternative embodiment, if the current lo- 
cation marker is not advanced, subsequent searches 
begin from the current location marker's original loca- 
tion. 

Those of ordinary skill will understand that many 
other GUI metacharacters could be provided by embod- 
iments of the present invention to control the operation 
of the GUI. The exemplary uses of GUI metacharacters 
above are provided as examples and should not limit 
the scope of the present invention. 

Using the methods illustrated in Figures 5-11 ena- 
bles a user to select selectable elements in a graphical 
user interface without the use of a mouse or pointing 
device. These methods are particularly useful for 
searching and selecting hypertext links from a large hy- 
pertext system containing lexically unordered data. The 
teachings and suggestions of the present invention al- 
low a user to quickly navigate to an appropriate hyper- 
text link by entering characters associated with the ap- 
propriate hypertext link. 

Embodiments of present invention provide a 
number of advantages over the methods used in the pri- 
or art. For example, embodiments of the present inven- 
tion do not interfere with the layout and placement of 
selectable elements in a GUI. In the prior art, some 
methods required the addition of numeric text to each 
selectable element. These additions destroyed the orig- 
inal layout intended by the original hypertext designers 
and were visually unappealing. Embodiments of the 
present invention require no additional text or modifica- 
tion for the hypertext selection to work. 

In addition, embodiments of the present invention 
require less keystrokes to search for a particular se- 
lectable element in a GUI based system than the prior 
art. Some prior art systems required a user to page 
through each selectable element one element at a time 
using an up or down keystroke on the keyboard. Getting 
to the last selectable element in a list required scrolling 
through each element. In contrast, embodiments of the 
present invention allow one to quickly search for the 
proper selectable element by entering only a few key- 
strokes. The user is quickly taken to the selectable ele- 
ment which matches the characters entered by the user. 
This is particularly useful in searching for hypertext links 
on the World Wide Web where there are many hypertext 
links which do not appear in alphabetical, chronological 
or numeric order. 

While specific embodiments have been described 
herein for purposes of illustration, various modifications 
may be made without departing from the spirit and 
scope of the invention. Various embodiments of the 
present invention can be implemented on the World 
Wide Web (WWW) or any other GUI based system 
which utilizes similar selectable elements. These vari- 
ous embodiments are particularly useful on GUI based 
systems where the selectable elements are lexically un- 
ordered and too numerous to simultaneously display on 



a single display screen. Accordingly, the invention is not 
limited to the above described embodiments, but in- 
stead is defined by the appended claims in light of their 
full scope of equivalents. 

5 

Claims 

1 . A method for facilitating the selection of at least one 
to selectable element from a multiplicity of lexically un- 
ordered selectable elements on a graphical user in- 
terface (GUI) having a plurality of elements, at least 
one of the multiplicity of selectable elements having 
a character portion, said method comprising the 
is computer implemented steps of: 

receiving one or more characters from a char- 
acter based input device; 
comparing said one or more characters re- 
20 ceived from said character based input device 

with said character portion from one or more of 
said multiplicity of lexically unordered selecta- 
ble elements; and 

matching said one or more characters received 
25 from said character based input device with 

said character portion of at least one selectable 
element within said multiplicity of lexically un- 
ordered selectable elements 

30 2. The method of Claim 1 further comprising the step 
of: 

arming a selectable element which matched 
said one or more characters received from said 
character based input device. 

35 

3. The method in Claim 2 wherein said arming step 
further comprises the step of disarming a previously 
armed selectable element before arming said se- 
lectable element which matched said one or more 

^0 characters received from said character based in- 
put device. 

4. The method of Claim 2 further comprising the step 
of: 

45 selecting said armed selectable element in re- 

sponse to receiving an actuation input signal which 
indicates said armed selectable element should be 
selected. 

50 5. The method of Claim 1 further comprising the step 
of: 

setting a current location marker to a prede- 
termined selectable element in said multiplicity of 
lexically unordered selectable elements, wherein 
55 said current location marker indicates which se- 
lectable element the comparing step should begin 
comparisons with. 
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6. The method in Claim 5 wherein said predetermined 
selectable element is said first selectable element 
in said multiplicity of lexically unordered selectable 
elements. 

7. The method in Claim 5 further comprising the step 
of advancing said current location marker to said 
selectable element immediately subsequent to a 
selectable element which matches said one or more 
characters received from said character based in- 
put device. 

8. The method in Claim 1 further comprising the step 
of receiving a GUI metacharacter from said charac- 
ter based input device, wherein said GUI metach- 
aracter controls a predetermined function of the 
GUI. 

The method in Claim 8 further comprising the steps 
of: 

receiving a fast path store GUI metacharacter 
from said character based input device: and 
in response to receiving said fast path store 
GUI metacharacter, storing an armed selecta- 
ble element in a fast path selection list, wherein 
said selectable element is stored within said 
fast path selection list for rapid selection at a 
subsequent time period. 



9. 
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12. 



The method in Claim 1 wherein the selectable ele- 
ments are hypertext links. 

The method in Claim 1 wherein the selectable ele- 
ments are GUI buttons. 

An apparatus for facilitating the use of a character 
input device in the selection of at least one selecta- 
ble element from a multiplicity of lexically unordered 
selectable elements on a graphical user interface 
(GUI) program having a plurality of elements, at 
least one of said multiplicity of selectable elements 
having a character portion, said GUI executing on 
a computer system including a processor, a mem- 
ory, a display device displaying the graphical user 
interface (GUI), the character input device, a stor- 
age device, and a mechanism for communicating 
between the processor, the character input device 
and the memory, the memory including the graphi- 
cal user interface (GUI) program and a runtime sys- 
tem, said apparatus comprising: 

a receiver module configured to receive one or 
more characters from a character based input 
device; 

a comparison module configured to compare 
one or more characters received from the char- 
acter based input device with said character 
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portion from one or more of said multiplicity of 
lexically unordered selectable elements; and 
a match module configured to match said one 
or more characters received from said charac- 
ter based input device with said character por- 
tion of at least once selectable element within 
said multiplicity of lexically unordered selecta- 
ble elements. 

13. The apparatus of Claim 12 further comprising: 

an arming module configured to arm a selecta- 
ble element which matched said one or more 
characters received from said character based 
input device; and 

a selection module configured to select said 
armed selectable element in response to re- 
ceiving an actuation input signal 
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The apparatus in Claim 1 3 further comprising a cur- 
rent location marker set to a predetermined selecta- 
ble element in said multiplicity of lexically unordered 
selectable elements, wherein said current location 
marker indicates which selectable element said 
comparison module should begin comparisons 
with. 

15. The apparatus in Claim 14 where said current loca- 
tion marker is advanced to said selectable element 
subsequent to said selectable element which 
matches said one or more characters received from 
said character based input device. 

16. The apparatus in Claim 12 wherein the selectable 
elements are hypertext links. 

17. The apparatus in Claim 12 wherein the selectable 
elements are GUI buttons. 
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The apparatus in Claim 12 further comprising a re- 
ceiver module for receiving one or more GUI meta- 
characters from a character based input device, 
wherein a GUI metacharacter controls a predeter- 
mined function of the GUI. 



19. The apparatus in Claim 12 wherein said computer 
system is a client computer coupled to one or more 
server computer systems over a communications 
link and wherein data is exchanged between said 
client computer system and at least one server 
computer system over said communications link. 



20. The apparatus in Claim 12 wherein said computer 
system is a server computer coupled to one or more 
5 5 client computer systems over a communications 
link and wherein data is exchanged between said 
server computer system and at least one client 
computer system over said communications link. 
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21. A program storage device readable by a machine, 
tangibly embodying a program of instructions exe- 
cutable by the machine for facilitating the selection 
of at least one selectable element from a multiplicity 

of lexically unordered selectable elements on a 5 
graphical user interface (GUI), at least one selecta- 
ble element within said multiplicity of lexically unor- 
dered selectable elements having a character por- 
tion, said program comprising: 

10 

code that receives one or more characters from 
a character input device; 
code that compares one or more characters re- 
ceived from said character input device with 
said character portion from one or more of said *s 
multiplicity of lexically unordered selectable el- 
ements; and 

code that matches said one or more characters 
received from said character based input de- 
vice with at least one selectable element within 20 
said multiplicity of lexically unordered selecta- 
ble elements. 

22. The storage device of Claim 21 further comprising: 

code that arms a selectable element which 2s 
matched said one or more characters received from 
said character based input device. 

23. The storage device of Claim 22 further comprising: 

code that selects the armed selectable ele- 30 
ment in response to receiving an actuation input sig- 
nal. 

24. The storage device in Claim 21 wherein the selecta- 
ble elements are hypertext links. 35 

25. The storage device in Claim 21 wherein the selecta- 
ble elements are GUI buttons. 

26. The storage device in Claim 22 further comprising 40 
code capable of receiving one or more GUI meta- 
characters from a character based input device, 
wherein said GUI metacharacter controls a prede- 
termined function of the GUI. 



so 



ss 



11 



EP 0 816 990 A2 



This is a first entry|1l 



This is a second entry|2] 



This is a third entry(3) 
This is a fourth entryj4] 



FIG. 1 

Prior Art CERN Interface 



12 



EP 0 816 990 A2 



This is a first entry 



This is a second entry 



This is a third entry 



This is a fourth entry 



FIG. 2 

Prior Art LYNX Interface 



EP 0 816 990 A2 




BNSDOCID: <EP 081 6990 A2 I > 



14 



EP 0 816 990 A2 




BNSDOCID: <EP 081B990A2_L> 



15 



EP 0 816 990 A2 



502 



504 



Current location 
marker set to first 
selectable element 



522^ 



506 



Receive 
character 
input 



Add character 
to a match 
string 



510 




Yes 



Any selectable 
w element armed? 



Yes 



No 



516 



518 





Disarm previously 
armed selectable 
element 



Arm matching 
selectable element 



514 



Indicate 
error 





Advance 




current location 




marker 



524 



f 



Select armed 
selectable element 



.528 




FIG. 5 



526 




16 




I 



Load match string timer 
with predetermined 
timer value 



610 





Start match string timer 
count down 







.612 



FIG. 6 



17 



EP 0 816 990 A2 



(from Figure 5) 



506 



Add character 
to a match 
string 




(Return to Figure 5, step 522) 



706 



Scroll GUI to 
display next screen 
of information 



710 



Store current 
selectable element 
in fast path 



,714 



712 



Remove characters 
from match string 



Receive 
character 
input 



(Return to Figure 5) 



FIG. 7 



(Return to Figure 5) 



18 



EP 0 816 990 A2 







p 


Q <D 


□ 










I Back to SunWeb Homepage 


Org. View 


Search 


Overview 


Help 




Son Microjyitcms | -> SunSoft -> Solaria Products Group -> Pctfctop Ifcchnototka - 


-> Jakob Nktsen 



Jakob Nielsen's Homepage 





802 






Info about Jakob Nielsen 


A 











Main Current Project 

• The Internet Desktop 

WWW User Interface Design 

• User interface design for Sun's new WWW paces 

• How we designed SunWeb 

• Directions Tor online publishing and the generations of online services 

Other Projects 

• Wbrtd Without Windows 

• The Anti-Mac user interface 

• Starfirc Pages on the WWW 

• Sherlock (new release of AnswerBook) 

• Monthly Alert Boa column 



FIG. 8 



no 1 coon ao I ^ 



19 



EP 0 816 990 A2 



Sun^H(Mj) 




P 


Q <D 












Back to Sun Web Homepage 


Org. View 


Search 


Overview 


Help 





Sun Micwxyttcraj -a j SunSoft} - > Sotortg Product! Group -> Pcaktop TfechooJogic* -> Jakob Hk ben 



Jakob Nielsen^^lomepage 

902 

Info about Jakob Nielsen 



Main Current Project 

• The Internet Desktop 

WWW User Interface Design 

• User interface design for Sun's new WWW pages 

• How we designed Sun Web 

• Directions for online publishing and the generations of online services 

Other Projects 

• World Without Windows 

• The Anti-Mac user interface 

• Starfire Pages on the WWW 

• Sherlock (new release of AnswerBook) 

• Monthly Alert Box column 



FIG. 9 




20 



EP 0 816 990 A2 







P 




□ 






a <o 




Back to SunWeb Homepage 


Org. View 


Search 


Overview 


Help 





Sun Mttcnxyitema -> SunSoft - > Solaria Pfodpctt Group -> Desktop Technotaaies -> Jakob Nklicti 



Jakob Nielsen's Homepage 





Info about Jakob Nielsen 


A0- 





Main Current Project 

• The Internet Desktop 

WWW User Interface Design 

• User interface design for Sun's new WWW pages 

• How we designed SunWeb 

• Directions for online publishing and the generations of online services 

Other Projects 10° 2 

• ¥terM WUMutWindows 

• Tke^ o ti-Mac user interface 

• | Starfirc) Pagea on the WWW 

• Sherlock (new release of AnswerBook) 

• Monthly Alert Box column 



FIG. 10 



21 



EP 0 816 990 A2 



1102 



1104 



1106 



This is a first entry 



pava applets on 
the WWW 



Iliis is a second fiPtq 



starfire pages 
on the WWW 



This is a third entry 



spare 
This is a fo ur th entr y 



This is a first entry 



' rhis is a second entr% 



This is a third entry 



1108 



1110 



1112 



1114 



1116 



1118 



This is a first entry 



java applets on 
the WWW 



rhis is a second entn 



starfire pages 
on the WWW 



This is a third.gntry 



spare 
This is a fourth entry 



1120 



This is a fifSt entry 



This is a second entry 



This is a third entry 



FIG. 11 



22 



(19) 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 




II 




(12) 



(43) Date of publication: 

07.01.1998 Bulletin 1998/02 



di) EP 0 816 990 A2 

EUROPEAN PATENT APPLICATION 

(51) mtci.6; G06F 3/023, G06F 9/44 



(21) Application number 97304491.0 

(22) Date of filing: 25.06.1997 



(84) Designated Contracting States: 

AT BE CH DE DK ES Fl FR GB GR IE IT LI LU MC 
NL PT SE 

Designated Extension States: 
AL LT LV RO SI 

(30) Priority: 26.06.1996 US 670952 

(71) Applicant SUN MICROSYSTEMS, INC. 
Mountain View, CA 94043 (US) 



(72) Inventors: 

• Nielsen, Jakob 

Atherton, California 94027 (US) 

• Johnson, Earl 

San Jose, California 95136 (US) 

• Gentner, Donald R. 

Palo Alto, California 94301 (US) 

(74) Representative: W.P. Thompson & Co. 
Coopers Building, 
Church Street 
Liverpool L1 3AB (GB) 



(54) Method and system for facilitating access to selectable elements on a graphical user 
interface 



(57) In one embodiment, the present invention pro- 
vides a method of selecting a selectable element with a 
character input device from a list of lexically unordered 
selectable elements on a graphical user interface (GUI). 
Typically, these selectable elements include hypertext 
links and GUI buttons on the GUI of computer program 
executing on a computer system. Each selectable ele- 
ment includes a character portion of data which facili- 
tates selecting the selectable element. The method typ- 
ically begins the selection process when a user enters 
one or more characters from a character input device. 
In response to receiving the characters, the present in- 
vention inserts each character into a match string. The 
match string is then compared with the character portion 
of each selectable element on the GUI : A selectable el- 
ement is "armed" when the character portion of a se- 
lectable element is found which matches the match 
string Arming a selectable element prepares the ele- 
ment for selection and typically involves highlighting, un- 
derlining or otherwise distinguishing the hypertext link 
from other text on a page. The user can then select the 
armed selectable element by actuating the "enter" key 
If a hypertext selectable element is selected then the 
information associated with a destination node (e.g., a 
web page) is displayed for the user. Instead of selecting 
the armed selectable element, the user may search for 
a different selectable element by entering additional 
characters and not actuating the "enter" key. The meth- 
od disclosed provides an improved selection method 
over prior methods because a user can quickly search 
and select a selectable element by typing a minimum 



number of characters. 
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Description 

The present invention relates to a method and sys- 
tem for facilitating access to selectable elements on a 
graphical user interface (GUI) used on computer sys- 
tems. 

More particularly the present invention relates to a 
method and system for accessing the selectable ele- 
ments in a GUI without a pointing device. 

Most computer programs executed on a computer 
system are controlled with a graphical user interface 
(GUI). The GUI displays selectable elements such as 
hypertext links and GUI buttons on a display device for 
the user to view and select. Typically, the user must use 
a pointing device, such as a mouse or trackball, to select 
the selectable elements provided by the GUI. Unfortu- 
nately, users who do not use a pointing device may be 
unable to use GUI based computer programs. For ex- 
ample, some users may have permanent physical dis- 
abilities or repetitive motion diseases, such as carpal 
tunnel syndrome, which prevents them Irom using a 
mouse or other pointing device In other cases, the user 
may not want to use a pointing device in order to mini- 
mize the homing time associated with moving from the 
keyboard to the pointing device and back It also may 
be necessary to eliminate the mouse from a computer 
system to reduce costs. In each case, these users would 
have great difficulty controlling a computer program 
which has a GUI interface. For these reasons, there is 
a need to-access the selectable elements of a GUI with- 
out a pointing device. 

Numerous conventional methods developed for se- 
lecting selectable elements on a GUI without a mouse 
or pointing device do not optimize a user's input speed. 
These methods were developed when the number of se- 
lectable elements in a given system were small and the 
information relatively ordered. In contrast, increasingly 
popular hypertext systems such as the World Wide Web 
(WWW) have hundreds of selectable hypertext links 
which are lexically unordered. As pointed out below, 
these conventional systems do not provide an efficient 
and easy method of accessing these hypertext systems 
without a pointing device. 

Figure 1 illustrates the technique developed by 
CERN for accessing a hypertext link without a pointing 
device. In this system, a number is assigned to each 
hypertext link and then added to the hypertext link text 
displayed to the user. A user can select a particular hy- 
pertext link by entering the hypertext link number on a 
keyboard device. Actuating the "enter" key takes the us- 
er to the information (e.g., a "web-page) associated with 
the selected hypertext link. 

Unfortunately, the CERN method of accessing hy- 
pertext links is aesthetically unappealing. Adding num- 
bers to each hypertext link changes the layout and ap- 
pearance of the hypertext and impairs the designers 
ability to control the presentation of information on a 
screen. This tends to clutter the interface with unneces- 



sary information and thus reduce the overall ease of use 
for the user. Furthermore, the numbers added to each 
hypertext link take up space which could be used to 
store and display additional meaningful information 
s rather than control information used to select the hyper- 
text link. 

The CERN system is also not advantageous on a 
system with a large number of hypertext links. In the 
CERN system a user can only view and select a link 

»o being displayed on the screen. Therefore, to view the 
additional links a user must scroll through numerous ad- 
ditional screens. Searching through a large number of 
hypertext links in this manner is both tedious and ineffi- 
cient For example, consider a web page on the WWW 

is which contains a list of all companies incorporated in the 
United States separated by each state. Many of the 
companies will have several entries on the web page 
because they are incorporated in several different 
states. A user may take hours to find the place of incor- 

20 poration for a particular company because he or she 
must scroll though multiple screens of information. Fur- 
thermore, the user will have no simple method of deter- 
mining if multiple entries in the hypertext system exist 
for a particular company. The CERN system will not in- 

2S dicate if multiple occurrences of a hypertext link appear 
on the same web page. Thus, the user may have a dif- 
ficulty determining if the company has been incorporat- 
ed in multiple states. 

The LYNX system is another method for accessing 

30 hyperlink information without using a pointing device. 
The LYNX system is shown in Figure 2 In the LYNX 
system a user must move sequentially through each hy- 
pertext link using a cursor key. A user actuates the "en- 
ter" key to select the hypertext link indicated by the cur- 

35 sor. 

The LYNX approach solves some problems found 
in the CERN interlace and introduces additional prob- 
lems of its own The LYNX technique is an improvement 
over the CERN interface because no additional text 

40 must be placed in the hypertext links. However, the 
LYNX approach remains undesirable because it re- 
quires numerous keystrokes to locate a specific hyper- 
text link. On a large hypertext system, the excessive 
number of keystrokes may deter the user from using the 

45 system. For example, assume the previously mentioned 
web page contained a list of approximately 1 ,000 com- 
panies. On the average, the LYNX system could require 
up to 500 keystrokes to locate a hypertext link for a par- 
ticular company. This is clearly an inefficient technique 

so for accessing hypertext or GUI system buttons without 
a pointing device. 

The present invention provides an elegant method 
for selecting selectable elements on a GUI without a 
pointing device. The present invention is particularly 

55 well suited for hypertext systems with a large number of 
hypertext links such as the World Wide Web(WWW). 
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SUMMARY OF THE INVENTION 

In one embodiment, the present Invention provides 
a method of selecting a selectable element from a list of 
selectable elements on a graphical user interface (GUI) s 
with a character based input device. The selectable el- 
ement is defined as any portion of the GUI responsive 
to the input signals from a pointing device or a character 
based input device. Typically, the selectable elements 
include hypertext and GUI buttons on the GUI of a com- w 
puter program executing on a computer. In one embod- 
iment, the selectable element includes a character por- 
tion of data which facilitates selecting the selectable el- 
ement. 

In one embodiment, the method begins the selec- is 
tion process upon receipt of one or more characters 
from a character based input device In response to re- 
ceiving the characters, the method inserts each charac- 
ter into a match string. The match string is then com- 
pared with the character portion of at least one selecta- 20 
ble element on the GUI. A selectable element is "armed" 
when a character portion of a selectable element is 
found which matches the match string. Arming a se- 
lectable element prepares the element for selection and 
typically involves highlighting, underlining or otherwise 2s 
distinguishing the hypertext link from other text on a 
page. The method selects the armed selectable element 
upon receipt of an "enter- key or an equivalent input sig- 
nal from a character based input device. If a selectable 
element is selected then the information associated with 30 
a destination node (e.g., a web page) is displayed on a 
display device. Instead of selecting the armed selecta- 
ble element, the method may search for a different se- 
lectable element upon receipt of additional characters 
from a character based input device. This particular em- 35 
bodiment provides an improved selection method over 
prior methods because it requires a minimum number 
of characters to quickly search and select a selectable 
element on a GUI. 

In another embodiment, a match string timer is used 40 
to remove all the characters from the match string after 
a predetermined time has elapsed and the user has pro- 
vided no input. This predetermined time interval begins 
when a user enters a first character In one embodiment, 
the match string timer is loaded with a predetermined 4S 
timeout value each time the method receives a new 
character The match string timer begins counting down 
immediately after detecting the new character. If the 
match string timer does not count down to zero before 
a subsequent character is entered, the additional char- so 
acter is appended to the match string. However, if the 
match string timer counts down to zero before a subse- 
quent character is received, the characters in the match 
string are removed and a subsequently entered charac- 
ter is inserted into an empty match string. In one em- ss 
bodiment. the predetermined time period is user defined 
and can be adjusted from one or more milliseconds up 
to one or more seconds of time. The match string timer 



allows the user to make a new search by pausing a few 
moments between keystrokes. 

In yet another embodiment, a current location mark- 
er is used to alter the order in which one or more se- 
lectable elements are matched with the match string. In- 
itially, the current location marker is set to the first se- 
lectable element in a list of selectable elements in the 
GUI The match string is first compared with the selecta - 
ble element indicated by the current location marker. If 
the comparison produces a match, the selectable ele- 
ment is armed and the current location marker is ad- 
vanced to the next selectable element immediately sub- 
sequent to the armed selectable element. If the compar- 
ison does not produce a match, the current location 
marker is advanced to the next selectable element in 
preparation for another comparison. In one embodi- 
ment, the current location marker is advanced until a 
match is found or comparisons are made with all the se- 
lectable elements. The current location marker facili- 
tates multiple searches on a GUI having a large number 
of selectable elements. Moreover, each search by the 
present method will begin with the last selectable ele- 
ment that was armed. 

The present invention is faster and more powerful 
than the prior art because it requires a minimum number 
of characters to quickly search and select a selectable 
element on a GUI. 

Notations and Nomenclature 

The detailed descriptions which follow are present- 
ed largely in terms of methods and symbolic represen- 
tations of operations on data bits within a computer. 
These method descriptions and representations are the 
means used by those skilled in the data processing arts 
to most effectively convey the substance of their work 
to others skilled in the art. 

A method is here, and generally, conceived to be a 
self-consistent sequence of steps leading to a desired 
result. These steps require physical manipulations of 
physical quantities. Usually, though not necessarily, 
these quantities take the form of electrical or magnetic 
signals capable of being stored, transferred, combined, 
compared, and otherwise manipulated. It proves con- 
venient at times, principally for reasons of common us- 
age, to refer to these signals as bits, values, elements, 
symbols, characters, terms, numbers, or the like. It 
should be bourne in mind, however, that all of these and 
similar terms are to be associated with the appropriate 
physical quantities and are merely convenient labels ap- 
plied to these quantities. 

Useful machines for performing the operations of 
the present invention include general purpose digital 
computers or similar devices. The general purpose 
computer may be selectively activated or reconfigured 
by a computer program stored in the'cbmputer. A special 
purpose computer may also be used to perform the op- 
erations of the present invention. In short, use of the 
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methods described and suggested herein is not limited 
to a particular computer configuration. 

The present invention will now be further described, 
by way of example, with reference to the accompanying 
drawings, in which: - 

Figure 1 illustrates a previously used technique de- 
veloped by CERN for accessing a hypertext link without 
a pointing device. 

Figure 2 illustrates the existing LYNX technique for 
accessing a hypertext link without a pointing device. 

Figure 3 is a block diagram of a computer system 
which provides an environment for practicing one em- 
bodiment of the present invention. 

Figure 4, illustrates a GUI system designed to dis- 
play information from the World Wide Web (WWW). 

Figure 5 is a flow diagram that provides an over- 
view of the processing that takes place when one em- 
bodiment is used to select various selectable elements 
without a pointing device or mouse. 

Figure 6 is a flow diagram that illustrates the steps 
to process a match string timer. 

Figure 7 is a flow diagram illustrating the steps tak- 
en to process GUI metacharacters. 

Figure 0 illustrates which hypertext link is highlight- 
ed on a web page from the World Wide Web when a 
user enters the character "S" from a keyboard device. 

Figure 9 illustrates which hypertext link is highlight- 
ed on a web page from the World Wide Web when a 
user enters the character "S" from a keyboard device at 
two separate instances 

Figure 10 illustrates which hypertext link is high- 
lighted on a web page from the World Wide Web when 
a user enters the characters "St' from a keyboard de- 
vice. 

Figure 11 illustrates various embodiments of the 
present invention using a fast path list for storing se- 
lectable elements in a GUI. 

DETAILED DESCRIPTION 

Overview Of an Embodiment ol the invention 

In one embodiment, the present invention provides 
a method of selecting a selectable element from a large 
number ol selectable elements on a graphical user in- 
terface (GUI) without a pointing device. The selectable 
element is defined as any portion of the GUI responsive 
to the input signals from a pointing device or a character 
based input device. Typically, these selectable elements 
include hypertext and GUI buttons on the GUI of a com- 
puter program executing on a computer. On most large 
network based systems, such as the World Wide Web 
(WWW), the selectable elements are not sorted lexically 
by title or topically according to their subject matter In- 
stead, data on the large network based systems re- 
mains unsorted. This vast amount of unsorted data 
makes accessing specific selectable elements especial- 
ly difficult The present embodiment provides an im- 



proved selection method over prior methods because it 
requires a minimum number of characters to quickly 
search and select a selectable element on a GUI. 

In one embodiment the method begins the selection 

5 process upon receipt of one or more characters from a 
character based input device. In response to receiving 
the characters, the method inserts each character into 
a match string. The match string is then matched with 
the character portion of each selectable element on the 

10 GUI. A selectable element is "armed' when a character 
portion of a selectable element is found which matches 
the match string. Arming a selectable element prepares 
the element for selection and typically involves highlight- 
ing, underlining or otherwise distinguishing the hyper- 

is text link from other text on a page. The method selects 
the armed selectable element upon receipt of an "enter" 
key or an equivalent input signal from a character based 
input device. If a selectable element is selected then the 
information associated with a destination node (e.g., a 

20 web page) is displayed on a display device. Instead of 
selecting the armed selectable element, the method 
may search for a different selectable element upon re- 
ceipt of additional characters from a character based in- 
put device. 

25 in another embodiment, a match string timer is used 
to remove all the characters from the match string after 
a predetermined time has elapsed and the user has pro- 
vided no input. This predetermined time interval begins 
when a user enters a first character. In one embodiment, 
30 the match string timer is loaded with a predetermined 
timeout value each time the method receives a new 
character. The match string timer begins counting down 
immediately after detecting the new character If the 
match string timer does not count down to zero before 
35 a subsequent character is entered, the additional char- 
acter is appended to the match string. However, if the 
match string timer counts down to zero before a subse- 
quent character is received, the characters in the match 
string are removed and a subsequently entered charac- 
40 ter is inserted into an empty match string. In one em- 
bodiment, the predetermined time period is user defined 
and can be adjusted from one or more milliseconds up 
to one or more seconds of time The match string timer 
allows the user to make a new search by pausing a few 
45 moments between keystrokes. 

In yet another embodiment, a current location mark- 
er is used to alter the order in which one or more se- 
lectable elements are matched with the match string. In- 
itially, the current location marker is set to the first se- 
50 lectable element in a list of selectable elements in the 
GUI. The match string is first compared with the selecta- 
ble element indicated by the current location marker. If 
the comparison produces a match, the selectable ele- 
ment is armed and the current location marker is ad- 
55 vanced to the next selectable element immediately sub- 
sequent to the armed selectable element. If the compar- 
ison does not produce a match, the current location 
marker is advanced to the next selectable element in 
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preparation for another comparison. In one embodi- 
ment, the current location marker is advanced until a 
match is found or comparisons are made with all the se- 
lectable elements. The current location marker facili- 
tates multiple searches on a GUI having a large number 
of selectable elements. Moreover, each search using 
this one embodiment will begin with the last selectable 
element that was armed. 

Embodiments of the present invention are faster 
and more powerful than the prior art because they re- 
quire a minimum number of characters to quickly search 
and select a selectable element on a GUI. 

Overview Of One Embodiment 

Figure 3 is a block diagram of a computer system 
300 which illustrates a computer system for practicing 
various embodiments of the present invention. Typically, 
a computer system 300 includes a computer 302, a dis- 
play device 304, an input device 306 such as a key- 
board, a primary storage device 308 and a secondary 
storage device 310. The display device 304 displays a 
graphical user interface (GUI) 31 2 for facilitating the dis- 
play of graphics and text for the user using the system 
300. Display devices 304 include, for example, printers 
and computer display screens such as cathode ray 
tubes (CRT's), light -emitting diode (LED) displays, and 
liquid crystal displays (LCD's), input devices 306 can in- 
clude, without limitation, electronic keyboards and point- 
ing devices such as electronic mice, trackballs, light- 
pens, thumbwheels, digitizing tablets, and touch sensi- 
tive pads. 

The computer 302 includes a processor 314 which 
fetches computer instructions from a primary storage 
308 through an interface 316, such as an input/output 
subsystem, connected to a bus 318. Computer 302 can 
be, but is not limited to, any of the SPARCstation or Ultra 
workstation computer systems available from Sun Mi- 
crosystems, Inc. of Mountain View, California, any other 
Macintosh computer systems based on the PowerPC 
processor and available from Apple Computer, Inc. of 
Cupertino, California, or any computer system compat- 
ible with the IBM PC computer systems available from 
International Business Machines, Corp of Somers, New 
York, which are based upon the X86 series of proces- 
sors available from the Intel Corporation or compatible 
processors. 1 Processor 314 executes these fetched 
computer instructions. The processor 31 4 can be, but is 
not limited to, any of the SPARC processors available 
from Sun Microsystems, Inc. of Mountain View, Califor- 
nia or any processors compatible therewith. Executing 
these computer instructions enables the processor 314 
to retrieve data or write data to the primary storage 308, 
display information on one or more computer display de- 
vices 304, receive command signals from one or more 

1 Sun. Sun MicWsystems, Ihe Sun logo. SPARC, and Ultra are trade- 
marks or registered trademarks of Sun Microsystems. Inc. in the United 
States or other countries. 



input devices 306, or transfer data to secondary storage 
310 or even other computer system which collectively 
form a computer network (not shown). Those skilled in 
the art understand that primary storage 308 and sec- 
5 ondary storage 310 can include any type of computer 
storage including, without limitation, randomly accessi- 
ble memory (RAM), read-only-memory (ROM), applica- 
tion specific integrated circuits (ASIC) and storage de- 
vices which include magnetic and optical storage media 
^0 such as CD-ROM. 

The primary storage 308 stores a number of items 
including a GUI program 320 and an runtime environ- 
ment 322. The runtime environment 322 typically is an 
operating system which manages computer resources, 
is such as memory, disk or processor time, required for the 
present invention to run. The runtime environment 322 
may also be a microkernel, a message passing system, 
one or more dynamic loadable linkable modules, a 
browser application for the World Wide Web. a runtime 
20 interpreter environment, or any other system which 
manages computer resources. 

The World Wide Web 

2S The exemplary embodiment described below in ac- 
cordance with Figures 5-11 selects selectable ele- 
ments, such as hypertext links, on the World Wide Web 
(WWW) without a pointer device. As such, it is useful to 
understand how the WWW is constructed and how one 
30 embodiment of the present invention could be used to 
select a selectable element on the WWW. 

Figure 4 illustrates a typical GUI based system 400 
designed to display information located on the WWW 
404. The WWW 404 is a warehouse for millions and mil- 
3$ lions of bytes of data contained in discrete storage ele- 
ments called web pages. A web page 406 contains data 
408 and a layout language 41 0 which describes how the 
data should be displayed. The layout language 410 
used within each web page, for example, includes any 
40 combination of Java™, JavaScript™, VRML, hypertext 
markup language (HTML) or any other language which 
supports hypertext functionality. 1 The user views a web 
page from the World Wide Web using a particular type 
of GUI program called a browser. A browser 402 accepts 
4* the data 408 and the layout language 410 and in re- 
sponse produces a graphical image containing hyper- 
text links along with text, graphics and various other 
types of multimedia. 

The hypertext links are of particular importance be- 
so cause they facilitate access to web pages located all 
over the WWW. An anchor tag in HTML is used to define 
a hypertext link on the WWW. The anchor tag has a des- 
tination portion and a text portion. Furthermore, the an- 
chor tag is delimited at the beginning by a "<A>" and at 
55 the end by a m </A>" character sequence. The destina- 

1. Sun. Sun Microsystems, the Sun togo. Java. and Javascripi are trade- 
marks or registered trademarks of Sun Microsystems. Inc. in the United 
States or other countries. 
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tion portion contains an entry which indicates the loca- 
tion of the destination web page. The text portion is the 
text which appears on the GUI and is associated with 
the hypertext link. For example, consider a hypertext 
link having the following HTML anchor tag: 

<A HREF=http://sunweb.ebay/sunweb/orge> 
Sun Microsystem«</A> 

The destination portion of this tag is 'http://sunweb. 
ebay/sunweb/orgs The text "Sun Microsystems" occu- 
pies the text portion of this HTML based hypertext link. 
In an exemplary embodiment, the text portion of the an- 
chor tag is utilized by the present invention, as described 
in detail later herein, to facilitate searching and selecting 
hypertext links on the WWW without a pointing device. 

The present invention is not limited for use with GUI 
systems designed for the WWW. One skilled in the art 
could apply the teachings and suggestions of the 
present invention to any GUI system which has text as- 
sociated with selectable elements. Essentially, selecta- 
ble elements includes all portions of the GUI which are 
responsive to the input signals from a pointing device or 
a character based input device. 

Exemplary Steps of One Embodiment 

Figures 5-11 illustrates one method for practicing 
the present invention. The flow diagrams described 
herein broadly illustrate the logical flow of steps to per- 
form one embodiment of the present invention. Accord- 
ingly, numerous steps may be added to, or taken away 
from the flow diagrams, without departing from the 
scope of the invention. Furthermore, the order of exe- 
cution of the steps in the flow diagrams may be changed 
without departing from the scope of the invention Addi- 
tional considerations in implementing the method de- 
scribed by the flow diagrams may also dictate changes 
in the selection and order of the steps 

Figure 5 is a flow diagram that provides an over- 
view of the processing that takes place in the GUI 402 
when an embodiment of the present invention is used 
to select various selectable elements without a pointing 
device or mouse. Before processing begins, the present 
embodiment initially requires a list of selectable ele- 
ments to select from Typically, a list of selectable ele- 
ments is generated from data provided by an underlying 
application using the GUI program. For example, on the 
World Wide Web (WWW) a web page contains a list of 
anchor tags which describe hypertext links in HTML. A 
browser processes these anchor tags and displays cor- 
responding hypertexl links to the user on a display de- 
vice. This embodiment receives the text portion of these 
anchor tags and creates a selectable element list for fur- 
ther processing described below 

Generally, selecting a selectable element requires 
several steps First, the user indicates to the method 
which selectable element should be armed by actuating 
one or more characters with a character based input de- 
vice. The method then highlights the armed selectable 



element in preparation for selection by the user. Next, 
the user actuates a selection character, such as an "en- 
ter* key, indicating that the armed selectable element 
should be selected In response to receiving the selec- 

s tion character, the method selects the armed selectable 
element. Generally, selecting a selectable element 
causes the functionality associated with the selectable 
element to be performed (i.e. retrieving a ■web" page). 
In one embodiment, selecting the selectable ele- 

10 ment follows the steps 502-528 in Figure 5. At step 502, 
the current location marker is set to the first selectable 
element in the selectable element list the first time the 
invention is used. The current location marker indicates 
which selectable element should be compared first in 

15 the matching process described below. For example, 
Figure 8 shows a web page displayed on a browser con- 
taining several hypertexl links as indicated by the un- 
derlined text. In an exemplary embodiment, the current 
location marker in Figure 8 is initially set to the first hy- 

20 pertext link 802 indicated by the characters "Sun Micro- 
systems' 

At step 504 the method receives a character on a 
character based input device such as a keyboard. In 
step 506, the method analyzes the character and deter- 

2S mines if the character received was an "enter - key In 
general, the "enter" key represents any input signal 
which indicates that a selectable element should be se- 
lected. If the method receives the "enter" key, the se- 
lectable element is selected as described in detail be- 

30 low At step 508, the method adds the character to a 
match string The match string holds a set of characters 
entered by the user for use in the matching step 510. 

At step 510 character comparison techniques well 
known in the art are used to compare the match string 

35 with one or more selectable elements In one embodi- 
ment, a sequence of one or more characters in the 
match string is compared to a sequence of one or more 
characters associated with one or more selectable ele- 
ments. The method begins the comparisons starting 

40 with the selectable element indicated by the current lo- 
cation marker 

Steps 516-520 prevent two selectable elements 
from being armed simultaneously Initially, a selectable 
element may be armed from a previous attempt to select 

45 a selectable element This occurs when the method 
arms a selectable element without subsequently select- 
ing it At step 516, the method detects if there is a pre- 
viously armed selectable element and a new selectable 
element is about to be armed. In one embodiment, if a 

50 selectable element was armed from a previous match- 
ing step, the method will disarm the previously armed 
selectable element at step 518 before the new matching 
selectable element is armed at step 520. If no selectable 
element was previously armed, the method will bypass 

55 step 518 and arm the matching selectable element at 
step 520 directly Generally, the selectable element is 
armed when the matching step determines the charac- 
ters within the match string match the text portion of the 
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selectable element Arming a selectable element in- 
cludes highlighting, underlining or otherwise distin- 
guishing the text of the selectable element from other 
text within the current page being displayed to the user. 

Figure 8 and Figure 1 0 will be used to illustrate how 
a previously armed selectable element is disarmed be- 
fore a new selectable element is armed. Assume a user 
has entered the character "S" with a keyboard device 
and caused the hypertext link 802 to become armed At 
this point, the current location marker is pointing to the 
hypertext link immediately subsequent to hypertext link 
802. Before selecting hypertext 802, however, the user 
then enters the letter V using the keyboard. The method 
adds the letter V to the match string (step 508) and pro- 
ceeds to compare the match string with the subsequent 
selectable elements starting with the current location 
marker. The method indicates a match between the 
match string and a hypertext link 1002 (step 510). As a 
result, step 518 disarms hypertext link 802 in Figure 8 
containing the text "Sun Microsystems" and arms the 
hypertext link 1002 in Figure 10 containing the text 
"Starfire". In this way, only one selectable element is 
armed at any given moment and the user is not distract- 
ed by having multiple selectable elements to choose 
from. Also, the previously armed selectable element re- 
mains visibly armed on the display unit up until a new 
selectable element is armed. 

Referring back to Figure 5, at step 528 the current 
location marker is advanced to the first selectable ele- 
ment subsequent to the matching selectable element 
This causes the next search to occur subsequent to the 
matching selectable element. For example, in Figure 8 
the current location marker is initially set to a hypertext 
link 802 because it is the first selectable element on the 
web page. Assume the method receives the letter "S" 
from a character based input device. The method re- 
ceives the letter "S" and places it in the match string 
(step 508) Next, the matching step compares the "S" in 
the match string with the character portion of one or 
more hypertext link in the current web page until a match 
is found (step 510). In this case, the matching step 510 
arms the hypertext link 802 in Figure 8 because the 
character "S" in the match string matches the character 
"S" in "Sun Microsystems". Moreover, the method ad- 
vances the current location marker to the first selectable 
element subsequent to the hypertext link 802 (e.g. the 
hypertext link containing the text "SunSoft"). Now as- 
sume the user removes the letter "S" from the match 
string by typing a backspace and then enters a new let- 
ter "S" into the match string. In this case, the method 
arms hypertext link 902 in Figure 9, in a manner de- 
scribed above, because the hypertext link 902 pointed 
to by the current location marker matches the match 
string. 

In some cases, the method will receive a sequence 
of characters from a character based input device which 
do not match any selectable element in the GUI. The 
user entering these characters may be searching for se- 



lectable elements which do not exist on the particular 
GUI being displayed. This portion of the invention han- 
dles the case where no selectable element matches the 
characters in the match string. Referring back to Figure 
s 5, at step 510 the method determines if the characters 
in the string do not match a selectable element. In one 
embodiment, if the selectable element has already been 
armed (step 512) the method will indicate an error (step 
514). Those of ordinary skill will understand that the er- 
10 ror indication provided by the method includes audio 
feedback, visual feedback or any other feedback capa- 
ble of indicating an error to the user. The error indicates 
that the additional characters received by the method 
do not match another selectable element on the GUI. 
15 Consequently, the method may already have armed the 
selectable element which most closely matches the 
characters in the match string. In contrast, if no selecta- 
ble element has been armed the method will return to 
step 504 to receive additional characters from the user 
20 and will not make an error indication. In this case, the 
method has not found a selectable element which 
matches the characters in the match string. 

After steps 512, 514, or 528. the method returns to 
step 504 to receive an additional character input from 
2S the user. This portion of the processing determines 
whether a selectable element should be armed or the 
armed selectable element should be selected. At step 
506, if an additional character, other than the "enter" key 
or an equivalent input signal, is provided, the method 
30 will add the character to the match string (step 508) and 
arm a selectable element in accordance with steps 
510-528. Alternatively at step 506, if the method re- 
ceives the "enter" key, or an equivalent input signal 
which indicates that a selectable element should be se- 
35 lected, the method first determines if a selectable ele- 
ment is currently armed (step 522). If a selectable ele- 
ment is currently armed (step 522), the method selects 
the armed selectable element (step 524). When the 
method selects the selectable element (step 524), the 
40 functionality associated with the selectable element is 
performed. For example, Figure 8 illustrates a previous- 
ly armed hypertext link 802 containing the words "Sun 
Microsystems". Upon receipt of the "enter" key, an ex- 
emplary embodiment selects hypertext link 602, re- 
45 theves the web page for "Sun Microsystems" and dis- 
plays the information associated with the web page on 
display device. 

If the method receives the "enter" key and no se- 
lectable element is currently armed then, at step 526, 
50 (he system will generate an error message for the user. 
This error indicates that the user of the method has at- 
tempted to select a selectable element which has not 
been armed. At step 526, various embodiments can be 
used to indicate that a user is attempting to select a se- 
55 lectable element before it has been armed. In one em- 
bodiment, an audible message is provided when a user 
tries to select a selectable element before a selectable 
element has been armed. In an alternative embodiment, 
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a visual image or message is provided to the user trying 
to select a selectable element before a selectable ele- 
ment has been armed For example, the method may 
provide an audible beep the first and second time the 
user actuates the "enter* key without a selectable ele- 
ment first being armed. The third time, however, a win- 
dow may appear indicating that the user has attempted 
to select a selectable element before an element has 
been armed. Those skilled in the art understand that var- 
ious combinations of audio and visual messages may 
be provided to ensure the user realizes an error has 
been made. 

The Match String Timer 

In an alternative embodiment, a match string timer 
is used to remove characters stored in the match string 
at step 508. Figure 6 is a flow diagram that illustrates 
the steps taken to process the match string using a 
match string timer. At step 602, an embodiment of the 
present invention receives a character from the user. At 
step 604, if the match string timer counts down to zero 
and times out the method removes all characters from 
the match string (step 606). However, if the match string 
timer has not timed out (step 604) then the method in- 
serts the character into the match string (step 608). 
Each time a character is received the system loads the 
match string timer with another predetermined timer val- 
ue (step 61 0). Immediately after loading the match string 
timer the match string timer begins a new countdown 
process (step 61 2) The match string timer ensures that 
a new match string is used at step S08 for comparisons 
when a user pauses a predetermined time interval be- 
tween key strokes. 

GUI Metacharacters 

In yet another alternative embodiment, the method 
receives a GUI metacharacter from a character based 
input device which controls the operation of the GUI. In 
one embodiment, these special keystrokes are reserved 
for use as GUI metacharacters and are not compared 
with the text of the selectable elements within the GUI. 
GUI metacharacters are advantageous in a mouseless 
environment because they provide an efficient method 
of controlling the GUI without a pointer device. In one 
embodiment, the processing of GUI metacharacters oc- 
curs after step 506 and before either step 504 or step 
508 Figure 7 illustrates the processing of these GUI 
metacharacters in detail. 

Referring to Figure 7, a flow diagram outlines the 
method in which several GUI metacharacters are proc- 
essed. The method performs steps 704-718 to process 
GUI metacharacter. At step 704, the method determines 
if the user provided a screen scroll GUI metacharacter. 
At step 706, the method causes a screen of information 
on the GUI to scroll up upon receipt of an up-screen 
scroll character (not shown). At step 706, the method 
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can also cause a screen of information on the GUI to 
scroll down upon receipt of a down-screen scroll char- 
acter (not shown). In one embodiment, the method sets 
the current location marker to the first selectable ele- 
5 ment which appears in the screen each time the GUI 
window scrolls up or down to a new set of selectable 
elements. 

At step 708, the method determines if the user pro- 
vided a fast path store keystroke The fast path list is a 

10 collection of often used or desirable selectable elements 
on the GUI. The method stores the armed selectable 
element to be stored in a fast path list upon receipt of a 
fast path store keystroke character. Later, the method 
provides the fast path list of selectable elements to the 

is user for additional searching. In one embodiment, the 
fast path list of selectable elements is displayed in a 
"pop-up" type window on the GUI. The user searches 
the fast path list by entering characters from a character 
based input device. In response, the method receives 

20 these characters and searches through the fast path list 
in a manner similar to the one described in steps 
502-528 

Figure 11 illustrates various embodiments of fast 
path lists for storing selectable elements in a GUI. In one 

25 embodiment, selectable elements from GUI pages 
1102, 1104, and 1106 are stored in separate fast path 
lists 1108, 1110. and 1112 respectively. This allows the 
user to segregate important hypertext links from each 
web page in separate lists In yet another embodiment, 

30 selectable elements retrieved from GUI pages 1114, 
1116, and 1 1 1 8 are stored in a single fast path list 11 20 
In this case, the user can consolidate all important hy- 
pertext links in a central location for easy access. Those 
skilled in the art understand that the selectable elements 

35 jn the fast path list may be deleted by user using tech- 
niques well known in the art. Furthermore, the Applicant 
contemplates that the hypertext links contained within 
the fast path lists in either embodiment can be sorted 
lexically, chronologically by topic, or even by frequency 

40 of use. 

Referring back to Figure 7, at step 712 the method 
may also determine if the user provided a clear match 
string GUI metacharacter In response to receiving the 
clear match string GUI metacharacter, the method re- 

45 moves all characters in the match string (step 714). This 
enables the user to quickly remove the characters in the 
match string and begin searching for a new selectable 
element in the GUI. 

In general, GUI metacharacters are designed to 

50 make searching and selecting a selectable element 
without a pointing device a more efficient process. In 
one embodiment, if a combination of GUI metacharac- 
ters arms a selectable element, the current location 
marker is advanced to the next subsequent selectable 

55 element. This enables the user to advance the current 
location marker using one or more GUI metacharacters 
and then begin searching subsequent to the current lo- 
cation marker's new location. For example, a user en- 
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ters several "tab" keystrokes to advance to a particular 
hypertext link on a web page. In one embodiment, the 
particular hypertext link is armed and the current loca- 
tion marker is advanced to the next subsequent hyper- 
text link. In an alternative embodiment, if the current lo- s 
cation marker is not advanced, subsequent searches 
begin from the current location marker's original loca- 
tion. 

Those of ordinary skill will understand that many 
other GUI metacharacters could be provided by embod- io 
iments of the present invention to control the operation 
of the GUI. The exemplary uses of GUI metacharacters 
above are provided as examples and should not limit 
the scope of the present invention. 

Using the methods illustrated in Figures 5-11 ena- is 
bles a user to select selectable elements in a graphical 
user interface without the use of a mouse or pointing 
device. These methods are particularly useful for 
searching and selecting hypertext links from a large hy- 
pertext system containing lexically unordered data. The 20 
teachings and suggestions of the present invention al- 
low a user to quickly navigate to an appropriate hyper- 
text link by entering characters associated with the ap- 
propriate hypertext link. 

Embodiments of present invention provide a 25 
number of advantages over the methods used in the pri- 
or art. For example, embodiments of the present inven- 
tion do not interfere with the layout and placement of 
selectable elements in a GUI. In the prior art, some 
methods required the addition of numeric text to each 30 
selectable element. These additions destroyed the orig- 
inal layout intended by the original hypertext designers 
and were visually unappealing. Embodiments of the 
present invention require no additional text or modifica- 
tion for the hypertext selection to work. 35 

In addition, embodiments of the present invention 
require less keystrokes to search for a particular se- 
lectable element in a GUI based system than the prior 
art. Some prior art systems required a user to page 
through each selectable element one element at a time 40 
using an up or down keystroke on the keyboard. Getting 
to the last selectable element in a list required scrolling 
through each element. In contrast, embodiments of the 
present invention allow one to quickly search for the 
proper selectable element by entering only a few key- 45 
strokes. The user is quickly taken to the selectable ele- 
ment which matches the characters entered by the user. 
This is particularly useful in searching for hypertext links 
on the World Wide Web where there are many hypertext 
links which do not appear in alphabetical, chronological so 
or numeric order. 

While specific embodiments have been described 
herein for purposes of illustration, various modifications 
may be made without departing from the spirit and 
scope of the invention. Various embodiments of the ss 
present invention can be implemented on the World 
Wide Web (WWW) or any other GUI based system 
which utilizes similar selectable elements. These vari- 



ous embodiments are particularly useful on GUI based 
systems where the selectable elements are lexically un- 
ordered and too numerous to simultaneously display on 
a single display screen. Accordingly, the invention is not 
limited to the above described embodiments, but in- 
stead is defined by the appended claims in light of their 
full scope of equivalents. 



Claims 

1 . A method for facilitating the selection of at least one 
selectable element from a multiplicity of lexically un- 
ordered selectable elements on a graphical user in- 
terface (GUI) having a plurality of elements, at least 
one of the multiplicity of selectable elements having 
a character portion, said method comprising the 
computer implemented steps of: 

receiving one or more characters from a char- 
acter based input device; 
comparing said one or more characters re- 
ceived from said character based input device 
with said character portion from one or more of 
said multiplicity of lexically unordered selecta- 
ble elements; and 

matching said one or more characters received 
from said character based input device with 
said character portion of at least one selectable 
element within said multiplicity of lexically un- 
ordered selectable elements 

2. The method of Claim 1 further comprising the step 
of: 

arming a selectable element which matched 
said one or more characters received from said 
character based input device. 

3. The method in Claim 2 wherein said arming step 
further comprises the step of disarming a previously 
armed selectable element before arming said se- 
lectable element which matched said one or more 
characters received from said character based in- 
put device. 

4. The method of Claim 2 further comprising the step 
of: 

selecting said armed selectable element in re- 
sponse to receiving an actuation input signal which 
indicates said armed selectable element should be 
selected. 

5. The method of Claim 1 further comprising the step 
of: 

setting a current location marker to a prede- 
termined selectable element in said multiplicity of 
lexically unordered selectable elements, wherein 
said current location marker indicates which se- 
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a comparison module configured to compare 
one or more characters received from the char- 
acter based input device with said character 
portion from one or more of said multiplicity ot 
5 lexically unordered selectable elements; and 

a match module configured to match said one 
or more characters received from said charac- 
ter based input device with said character por- 
tion of at least once selectable element within 
io said multiplicity of lexically unordered selecta- 

ble elements. 

13. The apparatus of Claim 12 further comprising: 

is an arming module configured to arm a selecta- 

ble element which matched said one or more 
characters received from said character based 
input device; and 

a selection module configured to select said 
20 armed selectable element in response to re- 

ceiving an actuation input signal. 

14. The apparatus in Claim 1 3 further comprising a cur- 
rent location marker set to a predetermined selecta- 

25 ble element in said multiplicity of lexically unordered 
selectable elements, wherein said current location 
marker indicates which selectable element said 
comparison module should begin comparisons 
with 

30 

15. The apparatus in Claim 1 4 where said current loca- 
tion marker is advanced to said selectable element 
subsequent to said selectable element which 
matches said one or more characters received from 

35 said character based input device. 
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lectable element the comparing step should begin 
comparisons with. 

6. The method in Claim 5 wherein said predetermined 
selectable element is said first selectable element 
in said multiplicity of lexically unordered selectable 
elements 

7. The method in Claim 5 further comprising the step 
of advancing said current location marker to said 
selectable element immediately subsequent to a 
selectable element which matches said one or more 
characters received from said character based in- 
put device 

8. The method in Claim 1 further comprising the step 
of receiving a GUI metacharacter from said charac- 
ter based input device, wherein said GUI metach- 
aracter controls a predetermined function of the 
GUI. 

9. The method in Claim 8 further comprising the steps 
of: 

receiving a fast path store GUI metacharacter 
from said character based input device; and 
in response to receiving said fast path store 
GUI metacharacter, storing an armed selecta- 
ble element in a fast path selection list, wherein 
said selectable element is stored within said 
fast path selection list for rapid selection at a 
subsequent time period. 

10. The method in Claim 1 wherein the selectable ele- 
ments are hypertext links. 

11. The method in Claim 1 wherein the selectable ele- 
ments are GUI buttons. 

12. An apparatus for facilitating the use of a character 
input device in the selection of at least one selecta- 
ble element from a multiplicity ol lexically unordered 
selectable elements on a graphical user interface 
(GUI) program having a plurality of elements, at 
least one of said multiplicity of selectable elements 
having a character portion, said GUI executing on 
a computer system including a processor, a mem- 
ory, a display device displaying the graphical user 
interface (GUI), the character input device, a stor- 
age device, and a mechanism for communicating 
between the processor, the character input device 
and the memory, the memory including the graphi- 
cal user interlace (GUI) program and a runtime sys- 
tem, said apparatus comprising: 

a receiver module configured to receive one or 
more characters from a character based input 
device; 



16. The apparatus in Claim 12 wherein the selectable 
elements are hypertext links. 

40 17. The apparatus in Claim 12 wherein the selectable 
elements are GUI buttons 

18. The apparatus in Claim 12 further comprising a re- 
ceiver module for receiving one or more GUI meta- 

45 characters from a character based input device, 
wherein a GUI metacharacter controls a predeter- 
mined function of the GUI. 

19. The apparatus in Claim 12 wherein said computer 
50 system is a client computer coupled to one or more 

server computer systems over a communications 
link and wherein data is exchanged between said 
client computer system and at least one server 
computer system over said communications link 

55 

20. The apparatus in Claim 12 wherein said computer 
system is a server computer coupled to one or more 
client computer systems over a communications 
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link and wherein data is exchanged between said 
server computer system and at least one client 
computer system over said communications link. 

21. A program storage device readable by a machine, s 
tangibly embodying a program of instructions exe- 
cutable by the machine for facilitating the selection 
of at least one selectable element from a multiplicity 
of lexically unordered selectable elements on a 
graphical user interface (GUI), at least one selecta- 10 
ble element within said multiplicity of lexically unor- 
dered selectable elements having a character por- 
tion, said program comprising: 

code that receives one or more characters from is 
a character input device; 
code that compares one or more characters re- 
ceived from said character input device with 
said character portion from one or more of said 
multiplicity of lexically unordered selectable el- 20 
ements; and 

code that matches said one or more characters 
received from said character based input de- 
vice with at least one selectable element within 
said multiplicity of lexically unordered selecta- 25 
ble elements. 

22. The storage device of Claim 21 further comprising. 

code that arms a selectable element which 
matched said one or more characters received from 30 
said character based input device. 

23. The storage device of Claim 22 further comprising: 

code that selects the armed selectable ele- 
ment in response to receiving an actuation input sig- 36 
nal. 

24. The storage device in Claim 21 wherein the selecta- 
ble elements are hypertext links. 

40 

25. The storage device in Claim 21 wherein the selecta- 
ble elements are GUI buttons. 

>6. The storage device in Claim 22 further comprising 
code capable of receiving one or more GUI meta- 45 
characters from a character based input device, 
wherein said GUI metacharacter controls a prede- 
termined function of the GUI. 
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(57) In one embodiment, the present invention pro- 
vides a method of selecting a selectable element with a 
character input device from a list of lexically unordered 
selectable elements on a graphical user interface (GUI). 
Typically, these selectable elements include hypertext 
links and GUI buttons on the GUI of computer program 
executing on a computer system. Each selectable ele- 
ment includes a character portion of data which facili- 
tates selecting the selectable element. The method typ- 
ically begins the selection process when a user enters 
one or more characters from a character input device. 
In response to receiving the characters, the present in- 
vention inserts each character into a match string. The 
match string is then compared with the character portion 
of each selectable element on the GUI. A selectable el- 
ement is "armed" when the character portion of a se- 
lectable element is found which matches the match 
string. Arming a selectable element prepares the ele- 
ment for selection and typically involves highlighting, un- 
derlining or otherwise distinguishing the hypertext link 
from other text on a page. The user can then select the 
armed selectable element by actuating the "enter" key 
if a hypertext selectable element is selected then the 
information associated with a destination node (e.g., a 
web page) is displayed for the user. Instead of selecting 
the armed selectable element, the user may search for 
a different selectable element by entering additional 
characters and not actuating the "enter" key. The meth- 



od disclosed provides an improved selection method 
over prior methods because a user can quickly search 
and select a selectable etement by typing a minimum 
number of characters. 




Printed by Jouve. 75001 PARIS (Ffl) 



EP 0 816 990 A3 



European Patent 
Office 



EUROPEAN SEARCH REPORT 



Application Number 

EP 97 30 4491 



DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 



Citation of document with indication, where appropriate. 
of relevant passages 



Relevant 
to claim 



CLASSIFICATION OF THE 
APPLICATION (mt.CI-6) 



"MULTI-CHARACTER H-TO-HAWAII SEARCH 
CAPABILITY" 

IBM TECHNICAL DISCLOSURE BULLETIN, 
vol. 37, no. 12, December 1994, page 
285/286 XP000487787 
* the whole document * 

EP 0 428 261 A (LOTUS DEVELOPMENT CORP) 
22 May 1991 



* column 4, line 23 - line 44 * 

EP 0 328 831 A (HEWLETT PACKARD CO) 
23 August 1989 



* column 4, line 45 - column 5, line 30; 
claims; figures 3-7 * 

US 5 263 174 A (LAYMAN ANDREW J) 
16 November 1993 

* column 2, line 16 - line 55; figures * 

WO 94 17469 A (APPLE COMPUTER) 
4 August 1994 

* page 23, paragraph 2 - page 26, 
paragraph 1; figures 8-14, 19B * 



The present search report has been drawn up for ail claims 



1-3,12, 
13,21-23 



I- 5, 

II- 14, 
17, 
21-23,25 



I- 5, 

II- 14, 
17, 
21-23,25 



G06F3/023 
G06F9/44 



1-4,12, 
13,21,23 



TECHNICAL FIELDS 
SEARCHED (lnt.CI.6) 



G06F 



1,12,21 



Plac* Of BMfCh 

BERLIN 



Date of comptefeon at *•» MiKh 

22 January 1999 



Durand, J 



CATEGORY OF CITED DOCUMENTS 

X : particularly relevant ff taken aj one 

Y : particularly relevant if combined wth another 

document of tria same category 
A : teefmotogicfti background 
O : non -written disclosure 
P ! mtoi modiste document 



T : theory or principle underlying the invention 
E : earlier patent document, but published on or 

after the filing date 
D : document cited In the application 
L : document cited for other reason* 



& : member ol the same patent famiy, corresponding 



2 



EP 0 816 990 A3 



ANNEX TO THE EUROPEAN SEARCH REPORT 
ON EUROPEAN PATENT APPLICATION NO. 



EP 97 30 4491 



This annex lists the patent lamily members relating to the patent documents cHed in the above-mentioned European search renort 
fhe members are as contained in the European Patent Office EDP file on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of riformation. 

22-01-1999 



Patent document 




Publication 




Patent family 




Publication 


cited in search report 




date 








date 


EP 0428261 


A 


22-05-1991 


US 


5546525 


A 


13-08-1996 








CA 


2027157 


A 


14-05-1901 








JP 


3185550 


A 


13-08-1901 


EP 0328831 


A 


23-08-1989 


US 


4862390 


A 


29-08-1989 








CA 


1301348 


A 


19-05-1992 








DE 


3887496 


D 


10-03-1994 








DE 


3887496 


T 


09-06-1994 








HK 


26295 


A 


10-03-1995 








JP 


2004028 


A 


09-01-1990 








JP 


2750137 


B 


13-05-1998 


US 5263174 


A 


16-11-1993 


NONE 








W0 9417469 


A 


04-08-1994 


US 


5488685 


A 


30-01-1996 








US 


5825355 


A 


20-10-1998 








US 


5469540 


A 


21-11-1995 








AU 


6232394 


A 


15-08-1994 








DE 


4490464 


T 


22-02-1996 








GB 


2290208 


A,B 


13-12-1995 








GB 


2290209 


A,B 


13-12-1995 








JP 


8509308 


T 


01-10-1996 








US 


5828374 


A 


27-10-1998 








AU 


6232294 


A 


15-08-1994 








WO 


9417468 


A 


04-08-1994 








US 


5600779 


A 


04-02-1997 








US 


5550967 


A 


27-08-1996 








US 


5602996 


A 


11-02-1997 



For more details about this annex :see Official Journal of the European Patent Office, No. 12/82 



PA <* BLANK mm, 



